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SECTION  I 


INTRODUCTION 

Denote  by  <  x2  <  *“  <  xn  times  t0.  failure  of  n  items  whose 
unordered  failure  times  are  independent  and  identically  distributed.  Assume 
that  the  underlying  distribution  of  the  unordered  variates,  (l/o)f{(x-p)/o}, 
is  continuous  and  known  up  to  location  and  scale.  We  consider  the  problem 
of  predicting  xm  after  observing  only  Xj,  ....  xp,  where  1  <  r  <  m  <  n. 
Prediction  intervals  in  this  setting  have  been  studied  by  several  authors 
(Hewett  [1],  Lawless  [2],  Kaminsky  and  Nelson  [3],  Likes  [4],  Mann,  Schafer 
and  Singpurwalla  [5],  Mann  and  Grubbs  [6]).  Best  linear  unbiased  prediction 
of  xm  was  treated  by  Kaminsky  and  Nelson  [7].  A  significant  reduction  in 
mean  square  error  is  achieved  by  sacrificing  unbiasedness  and  investigating 
the  larger  class  of  linear  invariant  predictors  with  mean  square  error 
proportional  to  a2.  We  find  the  best  linear  invariant  predictors  and  we 
develop  two  simplified  linear  invariant  predictors.  The  relative  behavior 
of  the  predictors  is  indicated  in  Table  1  for  the  exponential,  chi,  normal, 
logistic,  extreme  value  and  double  exponential  distributions. 
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SECTION  II 


NOTATION 

The  order  statistics  can  be  written  (Lloyd  [8])  x^  =  p  +  c^o  + 

(1=1,  ....  n).  We  will  write  the  first  r  of  these  In  the  matrlc  form 

X  -  A0  +  e  where  V  -  (Xj . x^},  A  =  (l,o),  1'  =  (1 . 1) ( 1  x  r), 

a'  =  (o.,  ....  aj,  Q'  =  (y,o)  and  e'  =  (e.,  ej.  Thus,  our  problem 
i  r  i  r 

Is  to  predict  x„  =  A  0  +  em  {Am  =  (l,a  )}  from  X.  The  variance-covariance 
m  m  m  m  m 

matrix  of  X  Is  o2V  =  o2(Vjj)(l  <,  1,  j  <,  r).  Of  course,  a  and  V  do  not 
depend  on  u  or  a  and  E(c^)  *  0  (1=1,  ...,  n).  Denote 
cov(X',xm)  =  a2(vlm,  ....  vj  by  o2w'. 

When  both  m  and  a  are  unknown,  we  write  0'  =  (0,6)  and  for 
the  best  linear  unbiased  estimate  of  0'  and  best  linear  unbiased  predictor 
of  xm ,  respectively.  If  one  of  the  parameters  Is  known,  that  parameter 
will  appear  as  a  subscript  In  the  estimate  and  predictor.  Thus,  for  example, 
k  and  S  are  respectively  the  best  linear  unbiased  predictor  of  xm 
and  the  best  linear  unbiased  estimate  of  o  when  v  Is  known.  The  best 
linear  unbiased  predictors  and  their  mean  square  errors  are  given  Implicitly 
In  Theorem  1. 


SECTION  III 


BEST  LINEAR  INVARIANT  PREDICTION  OF  ^ 

There  Is  a  close  connection  between  best  linear  Invariant  prediction 
and  best  linear  Invariant  estimation,  as  we  see  In  the  following  theorem. 

It  should  be  pointed  out  that  the  theorem  Is  not  limited  to  the  order  stat¬ 
istics  but  could  be  stated  for  the  general  linear  model. 

Theorem  1.  Let  kj  s  1  -  w'V’*l  and  kg  =  am  -  w'V  *a  and  k'  =  (kj.k^). 
Let  the  variance-covariance  matrix  of  (k'<§,S)  be 


,cll  C12 


C12  C22 


and  var(a  )  =  c  a2. 

p  p 


(a)  If  y  and  a  are  unknown,  the  best  linear  invariant  predictor  of 


x  Is 
m 


xm  =  w'V_1X  +  kjp  +  (kg  -  c12/(l  +  Cgg)}o 

=  xm  "  {c12/^1  +  c22)}° 
with  mean  square  error 

M<*»>  ■  <,2,v™  -  W'V‘1"  +  'll  ■  c12/(1  *  c22» 

=  M^)  -  Cjg02/(1  +  Cgg) . 

(b)  If  y  is  known  and  a  unknown,  the  best  linear  invariant 
predictor  of  xm  is 

x  =  w'V  +  k.y  +  k9a  /(I  +  c  ) 
m  1  2  y  y 

=  x  +  k0c  a  /(I  +  c  ) 
my  2  p  u  y' 

with  mean  square  error 

M(xm  )  -  -  w'V-1w  +  k|c„/(l  +  c  )} 


mm 
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■  "<*„  >  '  k!cS°2/(1  *  '„>• 

(c)  If  a  Is  known  and  y  unknown,  the  best  linear  Invariant 

predictor  of  x  Is 
m 


\  -i 

x  ■  w'V  AX 
mo 


+  Vc 


+  k2o 


=  x. 


mo 


with  mean  square  error 

M<*J  *  <,2(vim  ’  "'v'lw  +  C11  *  cl2/c22>  ‘  M<V>- 

Proof.  We  prove  part  (a).  We  first  point  out  that  for  any  linear  predictor 
a'X,  the  mean  square  error,  E(xm  -  a'X)2  can  be  written  as 

M(a'X)  =  o2{v|m  -  w'V^w)  +  E(p'X  -  k'0)2,  (1) 

where  p  =  a  -  V"*w.  This  follows  from  the  easily  verified  facts, 

1)  x  -  a'X  =  e  -  w'V-1e  -  (p'X  -  k'0). 
m  m 

11)  E(em  -  w'V-1E)(p'X  -  k'0)  *  0, 
and 

HI)  E(e  -  w'V-1e)2  =  a2^  -  w'V_1w). 
m  mm 

Thus,  In  order  that  a'X  be  the  best  linear  invariant  predictor  of  x  , 

m 

p'X  must  be  the  best  linear  invariant  estimate  of  k'0.  From  Theorem  1 
of  Mann  [9],  we  see  that  p'X  =  k'0  +  {Cj2/(1  +  c22) ^  xm  =  w'V_1X  + 

kju  +  (k2  -  c12/(l  +  c22))a)  and  E(p'X  -  k'0)2  =  a2(c11  -  d|2/(l  +  c22)h 
That  xm  =  x,,,  -  (c12/(l  +  c22))o  and  M(xm)  =  M(xm)  -  cj2a2/(l  +  c22)  now 
follow  from  the  results  of  Kaminsky  and  Nelson  [7].  Parts  (b)  and  (c)  follow 
in  a  similar  fashion  from  the  results  of  Mann  [10]  and  Kaminsky  and  Nelson  [7]. 


Remark.  The  mean  square  error  (1)  can  be  rewritten  In  the  more  convenient 
form 

M(a'X)  =  o2{v  +  a'Va  -  2a'w  +  (a  -  a'a)2} 
mm  m 

+  (1  -  a'l)V  +  2(1  -  a'l)(am  -  a'a)yo. 


b 


Thus,  a'X  is  invariant  for  if  and  only  if  a'l  =  1  and  is  unbiased 
for  if  and  only  if,  in  addition,  a 'a  =  o^. 

Example  l.  Assume  that  the  parent  population  is  exponential, 

(l/o)exp{-(x  -  w)/o),  x  >  p,  o  >  0,  y  and  o  unknown.  We  find  w'V"1  = 

(0 . 0,1);  v  =  Xj  -  a/ n;  a  -  -(n  -  Dx^r  -  1)  +  -  1)  + 

(n  -  r  +  l)xr/(r  -  1);  var(o)  =  o2/(r  -  1);  var(i)  =  o2/{n2(r  -  1)}; 
co v(p,a)  =  -a2/{n(r  -  1)};  kj  =  0;  k2  =  6j.  where  we  define  6^  =  6^(r,m)  = 
Zj=r+l^n  ‘  j  +  ^_1  (i=1»2)-  Now*  =  xr  +  6f(r  -  l)/r  and  MfxJ  = 
o 2 ( 6 2  +  6|/r).  For  comparison,  xm  =  xr  +  6jO  and  H(xm)  =  o2{62  +  «|/(r-l)}. 
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SECTION  IV 

SIMPLIFIED  LINEAR  INVARIANT  PREDICTION 

Remark.  In  the  Interest  of  brevity,  we  will  assume  throughout  this 
section  that  both  y  and  a  are  unknown.  Also,  we  will  treat  only  Invariant 
prediction  (not  necessarily  unbiased).  The  corresponding  unbiased  predictors 
can  be  obtained  In  a  manner  quite  similar  to  that  outlined  below  by  adding 
the  appropriate  linear  constraint. 

There  are  only  a  few  distributions  of  which  we  know  (the  exponential, 
power-function,  Pareto  and  a  few  others)  where  the  best  linear  Invariant 
predictor  has  a  simple  closed  form.  This  Is  because  V  can  rarely  be 
inverted  algebralcly.  When  r  Is  large,  Inversion  of  V  can  be  especially 
troublesome.  These  observations  have  motivated  us  to  search  for  simplified 
predictors  which  do  not  depend  on  Inversion  of  V.  On  examination  of  the 
coefficients  of  5^  for  various  r,  m  and  n,  some  patterns  emerge. 

First,  In  distributions  not  having  an  unknown  lower  terminus,  such  as  the 
normal,  logistic,  extreme  value  and  double  exponential,  the  first  r  -  1 
coefficients  are.  In  general,  reasonably  close  to  one  another  with  a  jump 
occurring  at  the  r-th  coefficient.  Second,  In  distributions  with  an  unknown 
lower  terminus,  such  as  the  exponential  and  chi  distributions,  the  middle 
r  -  2  coefficients  of  xm  are  generally  reasonably  close  to  each  other 
(with  equality  for  the  exponential  distribution),  and  jumps  occur  at  the 
first  and  last  coefficients.  Also,  many  researchers  have  observed  that 
linear  estimates  of  location  and  scale  lose  efficiency  rather  slowly  as  the 
coefficients  are  changed,  while  maintaining  unbiasedness  or  Invariance 
(cf.  David  [11],  p.  108).  These  observations  lead  us  to  suggest  using 
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linear  Invariant  predictors  depending  on  two  weights  If  the  parent  distri¬ 
bution  does  not  have  an  unknown  lower  terminus  and  on  three  weights  other¬ 
wise.  Incidentally,  Table  1  indicates  that  the  two-weight  predictors  are 
fairly  eff.cient  even  In  distributions  which  do  possess  an  unknown  lower 
terminus. 

Our  two-weight  linear  Invariant  predictor  takes  the  form 
xj(x)  =  xtj‘;jx1/(r  -  1)  +  (1  -  X)xr, 

where  \  Is  some  real  constant.  The  mean  square  error  of  xjjj(x)t  viewed  as 
a  function  of  X,  Is  a  parabola,  opening  upward,  with  its  minimum  value  at 

.  vrr  ~  "n  *  I(,1m  ~  v1r>'f<r  '  *>  '  {ar  '  ~  Wh  '  °r> 

o  vrr  +  zzv^/fr  -  l)2  -  2Zv1r/(y  -  1)  +  (ar  -  Zoi/(r  -  l)}2 

all  summations  being  from  1  to  r  -  1.  We  write  x*  in  place  of  x*(xj 

m  m  o 

and  we  observe  that  inversion  of  V  is  unnecessary  to  compute  either  x* 
or  Its  mean  square  error. 

The  three-weight  linear  Invariant  predictor  takes  the  form 


xJ*(8.y)  =  exj  +  -  2)  +  (1  -  B  -  Y)xf 

The  mean  square  error  of  x**(b,y)»  viewed  as  a  function  of  B  and  y,  is 
a  paraboloid  opening  upward.  It  Is  elementary  to  verify  that  the  minimum 
mean  square  error  occurs  at  the  point 


where 


T 


{n  =  V11  ‘  2vrl  +  vrr  *  (ar  ‘  “l>2* 

ci2  =  r(vil  ’  Vir^r  ‘  2)  +  vrr  "  vrl  +  (ar  ”  al){ar  '  Za1/(r  '  2)3 » 

42  =  Kv.j/tr  -  2)2  -  2lv1r/(r  -  2)  +  vrr  +  (ar  -  Zo1-/(r  -  2)}2, 

ni  =  vlm  "  vrm  “  vlr  +  vrr  '  (ar  "  °1>K,  *  “r1* 
and 

n2  "  z^vim  “  vir^r  ^  “  vrm  +  vrr  ^“m  "  “r^ar  "  Soi/(r  "  ^3* 

where  all  simulations  run  from  2  to  r  -  1.  We  write  x**  in  place  of 

m 

x**(3^,y  ')  and  we  note  again  that  calculation  of  x**  or  its  mean  square 
oo  m 

error  does  not  require  inversion  of  V. 

Remark.  In  the  case  of  the  exponential  distribution,  xm  is  a  three-weight 

predictor  (see  Example  1),  so  that  x  =  x**. 

m  m 
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SECTION  V 

DISCUSSION  OF  THE  TABLE 


The  computations  for  Table  1  were  performed  on  the  Cyber  74  computer 
at  the  Wright- Patterson  Air  Force  Base,  Ohio.  The  arithmetic  was  accurate 
to  fourteen  decimal  places  but  was,  of  course,  limited  by  the  number  of 
significant  figures  In  the  tables  of  expectations  and  covariances.  These 
expectations  and  covariances  were  obtained  from  the  following  sources: 
Govlndarajulu  and  Elsenstat  [12],  the  chi  distribution 

f(x)  *  x  >  0; 


Sarhan  and  Greenberg  [13],  pp.  190-205,  the  normal  distribution 

f(x)  =  e’x2^2//2iT,  -»  <  x  <  », 

Birnbaum  and  Dudman  [14],  Gupta  and  Shah  [15],  Tartar  and  Clark  [16], 
Shah  [17]  and  Gupta,  Qurelshl  and  Shah  [18],  the  logistic  distribution 


F(x) 


s 


*  e'*^3 
/3  (1  +  e"^/^3)2 


> 


-CO  < 


x  <  -; 


Mann  [19],  the  extreme  value  distribution 

x-ex 

f ( x )  -  e  ,  -•  <  x  <  »; 

and  Govlndarajulu  [20],  the  double  exponential  distribution 


f(x)  =  e"lxl/2,  -»  <  x  <  ■>. 

Table  1  Is  Intended  to  give  some  Indication  of  the  relative  performance 

of  the  predictors  In  small  and  moderately  large  samples.  The  table  contains 

the  mean  square  errors  of  x  ,  5f  ,  x*  and  x**  (y  and  a  unknown)  for  n  =  7, 

m  m  m  m 

n  =  20  and  various  combinations  of  r  and  m,  for  the  five  distributions 
mentioned  above  and  the  exponential  distribution.  In  most  cases,  the  best 
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linear  Invariant  predictor  is  seen  to  reduce  mean  square  error  considerably 
below  that  of  the  best  linear  unbiased  predictor.  The  three-weight  predictor 
generally  comes  quite  close  to  the  best  linear  Invariant  predictor,  and,  in 
most  cases,  both  simplified  predictors  surpass  the  best  linear  unbiased  pre¬ 
dictor.  It  seems  likely  from  the  table  that  the  discrepancy  between  the 
mean  square  errors  of  the  unbiased  predictor  and  the  invariant  predictors 
increases  the  farther  away  m  is  from  r.  We  will  Illustrate  some  of  the 
computations  with  an  example. 

Example  2.  Seven  identical  items  whose  failure  times  are  known  to  follow 
the  chi  distribution  with  unknown  location  and  scale  are  simultaneously 
subjected  to  stress.  The  Items  function  Independently, and, after  the  first 
four  failures  have  been  observed,  we  wish  to  predict  the  time  of  the  last 
failure.  From  Govindarajulu  and  Elsenstat  [12],  we  find  y  ■  1.3108XJ  - 
O.OIO6X2  -  O.O246X3  '  °-2753x4  and  5  =  -2-0147XJ  +  0.1370x2  +  0.2093x3  + 
1.6685x4,  var(O)  =  0.0304o2,  var(o)  =  0.2388o2  and  cov( 5,5 )  =  -0.0485o2. 
Also,  we  find  that  w'V’*  =  (-0.0011,  -0.0018,  -0.0037,  0.6443),  w 'V'h  = 
0.6377  and  w'V_1a  =  0.4497.  The  four  predictors  are  x7  =  -2.0934xj  + 
0.1693x2  +  0.2534x3  +  2.6707x4,  x?  =  -1.6270x1  +  0.1375x2  +  0.2051x3  + 
2.2844x4,  x*  =  -0.6694(Xj  +  +  X3)  +  3.0082x4  and  x^*  =  -1.6401Xj  + 

0.1732(x2  +  X3)  +  2.2937x4<  From  Table  1  with  ,r  *  4,  m  *  7  and  n  =  7 
for  the  chi  distribution,  we  find  the  mean  square  errors  of  the  predictors 
to  be  M(x7)  =  0.5998a2,  M(%7)  =  0.5335a2,  M(x*)  =  0.5772a2  and 
M(x**)  =  0.5335a2. 
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Table  I.  Mean  square  errors  of  the  predictors  divided  by  a2. 


M(xJ) 

M(^) 

"(xj*) 

r  ! 

=  4,  m  ! 

=  5,  n  : 

»  7 

r  ! 

=  4,  m  : 

=  6,  n  = 

*  7 

Exponential 

0.1482 

0.1389 

0.1447 

0.1389 

0.5926 

0.5347 

0.5709 

0.5347 

Chi 

0.0644 

0.0606 

0.0628 

0.0606 

0.2066 

0.1876 

0.1994 

0.1876 

Normal 

0.1379 

0.1308 

0.1332 

0.1309 

0.3754 

0.3449 

0.3554 

0.3453 

Logistic 

0.1178 

0.1109 

0.1117 

0.1110 

0.3478 

0.3165 

0.3200 

0.3170 

Extreme  value 

0.1756 

0.1643 

0.1647 

0.1644 

0.4225 

0.3783 

0.3797 

0.3786 

Double  exponential 

0.1818 

0.1702 

0.1702 

0.1702 

0.6456 

0.5830 

0.5832 

0.5831 

r  ! 

=  4,  ra! 

5  7,  n  « 

=  7 

r  : 

=  5,  m  ! 

=  6,  n  ! 

=  20 

Exponential 

2.4815 

2.2014 

2.3764 

2.2014 

0.0056 

0.0053 

0.0055 

0.0053 

Chi 

0.5998 

0.5335 

0.5772 

0.5335 

0.0050 

0.0048 

0.0049 

0.0048 

Normal 

0.9147 

0.8239 

0.8555 

0.8251 

0.0275 

0.0266 

0.0268 

0.0266 

Logistic 

1.0507 

0.9437 

0.9542 

0.9454 

0.0255 

0.0244 

0.0245 

0.0245 

Extreme  value 

0.8453 

0.7325 

0.7355 

0.7331 

0.0646 

0.0620 

0.0621 

0.0621 

Double  exponential 

2.5376 

2.2605 

2.2611 

2.2609 

0.0501 

0.0481 

0.0481 

0.0481 

r  : 

=  5,  m  = 

=  13,  n 

=  20 

r  5 

s  5,  m  : 

*  20,  n 

=  20 

Exponential 

0-2002 

0.1739 

0.1938 

0.1739 

4.3331 

3.7826 

4.2002 

3.7826 

Chi 

0.1210 

0.1058 

0.1171 

0.1058 

1.0484 

0.9066 

1.0219 

0.9066 

Normal 

0.3438 

0.3065 

0.3153 

0.3070 

1.7008 

1.4939 

1.5427 

1.4964 

Logistic 

0.3111 

0.2707 

0.2715 

0.2709 

2.1589 

1.8702 

1.8741 

1.8714 

Extreme  value 

0.6362 

0.5517 

0.5521 

0.5518 

1.9460 

1.6343 

1.6354 

1.6345 

Double  exponential 

0.4976 

0.4338 

0.4338 

0.4338 

5.1414 

4.4474 

4.4474 

4.4474 

r  ■ 

■  10,  m 

•  11,  n  =  20 

r  ! 

=  10,  m 

=  15,  n  =  20 

Exponential 

0.0111 

0.0110 

0.0114 

0.0110 

0.1325 

0.1278 

0.1432 

0.1278 

Chi 

0.0063 

0.0063 

0.0064 

0.0063 

0.0571 

0.0552 

0.0614 

0.0553 

Normal 

0.0158 

0.0157 

0.0159 

0.0157 

0.1102 

0.1072 

0.1125 

0.1081 

Logistic 

0.0126 

0.0125 

0.0125 

0.0125 

0.0940 

0.0909 

0.0920 

0.0914 

Extreme  value 

0.0217 

0.0215 

0.0216 

0.0215 

0.1316 

0.1267 

0.1274 

0.1271 

Double  exponential 

0.0148 

0.0146 

0.0146 

0.0146 

0.1421 

0.1370 

0.1371 

0.1371 

r  = 

:  10,  m 

=  20,  n  =  20 

r  5 

!  15,  m 

=  16,  n  =  20 

Exponential 

2.5030 

2.4077 

2.7243 

2.4077 

0.0429 

0.0427 

0.0443 

0.0427 

Chi 

0.4681 

0.4498 

0.5202 

0.4499 

0.0142 

0.0142 

0.0147 

0.0142 

Normal 

0.6369 

0.6142 

0.6544 

0.6211 

0.0234 

0.0233 

0.0238 

0.0234 

Logistic 

0.9086 

0.8771 

0.8838 

0.8796 

0.0215 

0.0214 

0.0217 

0.0216 

Extreme  value 

0.4876 

0.4605 

0.4635 

0.4622 

0.0198 

0.0197 

0.0198 

0.0198 

Double  exponential 

2.5189 

2.4237 

2.4239 

2.4239 

0.0428 

0.0427 

0.0429 

0.0428 

r  = 

!  15,  m 

=  18,  n  =  20 

r  = 

:  15,  m 

=  20,  n  =  20 

Exponential 

0.2574 

0.2545 

0.2800 

0.2545 

1.8360 

1.8112 

2.0272 

1.8112 

Chi 

0.0675 

0.0669 

0.0734 

0.0669 

0.2899 

0.2863 

0.3253 

0.2865 

Normal 

0.0993 

0.0984 

0.1043 

0.1000 

0.3685 

0.3642 

0.3935 

0.3722 

Logistic 

0.1051 

0.1042 

0.1077 

0.1061 

0.5988 

0.5928 

0.6128 

0.6044 

Extreme  value 

0.0741 

0.0731 

0.0743 

0.0739 

0.2041 

0.2001 

0.2045 

0.2030 

Double  exponential 

0.2564 

0.2536 

0.2567 

0.2559 

1.8266 

1.8030 

1.8293 

1.8224 
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SECTION  VI 


SOME  COMMENTS  ON  TWO-SAMPLE  PREDICTION 

The  procedures  discussed  in  the  preceding  sections  extend  easily  to 
two-sample  prediction.  Specifically,  suppose  we  wish  to  predict  the  m'-th 
failure  time,  ym^,  in  a  future,  independent  sample  of  size  n'  from  the 
same  population,  the  predictor  being  based  on  X,  where  now  r  may 
equal  n.  Prediction  intervals  in  this  setting  have  been  studied  by  Mann 
and  Saunders  [9],  Lawless  [21,  22,  23],  Antle  and  Rademaker  [24],  Kaminsky 
and  Nelson  [3],  Mann,  Schafer  and  Singpurwalla  [5]  and  Fertig  and  Mann  [25]. 

It  is  easy  to  show  that  y  ,=  E(y  ,)  and  y  £(y  J.  That  is,  the 

mm  mm 

best  predictor  of  y  ,  is  the  best  estimate  of  E(ymJ  in  both  the  unbiased 
and  the  invariant  cases.  This  follows  from  the  independence  of  the  two  samples. 
Simplified  predictors  of  ym-  can  also  be  derived  as  in  54.  We  will  not 
pursue  these  ideas  further  at  this  time. 
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